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SUMMARY 

In  a  recent  paper,  Ikebe  and  Kato  dlecueeed  the  use  of  the 
variational  problem  of  minimizing  J(u)  -  y^(u'^ 

In  connection  with  the  numerical  solution  of  the  Eraden— Powler- 
Thomas— Perml  equation  u’’  —  -  0,  u(0)  ■  1,u(gd  )  ■  0. 

In  this  paper,  we  consider  the  application  of  the  theory  of 
dynamic  programming  to  this  minimization  problem  and  present 
two  approaches.  Computational  results  will  be  precented  sub¬ 
sequently  . 
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DYNAMIC  PROGRAMMING  AND  THE  VARIATIONAL  SOLUTION  OP  THE 

THOMAS-PERMI  EQUATION 

By 

Richard  Bellman 


§1 .  Introduction 

In  a  recent  paper,  Ikebe  and  Kato,  [8],  considered  the 
problem  of  the  numerical  Integration  of  the  nonlinear  equation 

(1)  u"  -  -  0,  u(0)  -  1,u(cd)  -  0, 

which  arises  In  connection  with  the  Thomas-Ferml  statistical 
model  of  a  free  neutral  atom. 

The  general  equation 

( 2 )  u  '  '  -  u™x*^  "O,  — oo<ra,n<aD, 

arose  a  number  of  years  before  In  connection  with  some  astro^hy— 
slcal  problems,  see  Emden,  [*4]  .  This  equation,  together  with 
the  equations 

(5)  u''-»-ux  -  0,u'Ue  u  »C, 

was  discussed  In  painstaking  detail  by  Fowler  In  a  series  of 
papers,  [5],  [6j ,  ,  where  Emden'r  results  arc  considerably 

extended.  A  unified  and  In  some  cases  simplified  presentation 
of  Fowler's  results  Is  contained  In  the  author's  book,  [3]. 

A  later  treatment  of  these  equations  Is  given  In  Sansone,  [9]. 

In  their  paper,  Ikebe  and  Kato  treat  the  problem  of  deters 
mining  u'(0)  by  means  of  the  associated  variational  problem: 
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Minimize  the  functional 

(4)  J(u)  -  4-  -  u^/V^/^)dx 

O  5 

over  the  functions  for  which  the  Integral  exists,  and  which  satlsf 
tne  constraints 

(5)  u(0)  -  1,  u(oo  )  -  0. 

In  this  paper,  we  wish  to  Indicate  a  new  numerical  technique 
for  Integrating  nonlinear  differential  equations  satisfying  two- 
point  boundary  conditions  which  arise  from  variational  problems. 
This  Is  based  upon  the  new  approach  to  the  calculus  of  variations 
embodied  In  the  theory  of  dynamic  programming,  [l] ,  [?] . 

Detailed  computations  based  upon  these  results  will  be 
presented  subsequently.  Here  we  wish  to  derive  an  Interesting 
first  order  nonlinear  differential  equation  associated  with 
the  variational  problem,  derived  from  the  functional  equation 
technique  of  dynamic  programming.  A  corresponding  result  may 
be  obtained  for  the  variational  problem  associated  with 

(6)  u"  -  e'^^u'"  -  0. 

§2.  Dynamic  Prograunmlng  and  Two— Point  Boundary  Problems 
Consider  the  nonlinear  differential  equation 

(1)  .0, 

u(a)  -  c,  u(b)  -  c^, 

taken  to  be  the  Euler  equation  dT  the  variational  problem: 
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(2)  J(u)  [u'^  g(u,x)jdx 

a 

over  all  functions  u(x)  satisfying  u(a)  -  c,  u(b)  -  c^. 

For  fixed  upper  limit  b  and  boundary  value  let  us  regard 
the  mlnlaun  of  J(u)  as  a  function  of  the  lower  limit  a,  and  the 
value  of  u(a),  namely  c,  for  the  range  of  values  -  od  <  a  <  b, 

-  00  <  C  <00 

We  write 

(3)  f(»,c)  .  Min  J(u) 

u 

Then,  as  we  have  shown  before,  [l],  [2j,the  function  f(a,c) 
satisfies  tae  nonlinear  partial  differential  equation 

Min  I  v^  -»•  g(c,a)  +  v  ^ 

V  L  j 

(  )  -  g{c,a) . 

We  must  be  careful  about  imposing  boundary  conditions,  since  as 

b 

a  — >  b,  assuming  that  g(u,x)dx  — >  0,  we  have 

(c-c, 

(6)  f(a,c)  or  -  . 

(b— a  ) 

Actually, for  numerical  purposes.  It  Is  better  to  use  a  discrete 
version  of  the  original  problem  than  a  finite  difference  sobeme 
associated  with  (5),  cf.  [1].  We  shall  discuss  these  matters 
In  a  subsequent  paper. 


(4) 


£f 

da 


which  yields 
(5) 


il-  i 

<9a  4 
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The  elope  u'(a)  Is  equal  to  the  minimizing  v  In  (4), 
Which  In  this  caee  hac  the  value 

(7)  V  .  -  i  . 

2  dc 

Thus  the  determination  of  the  function  f(a,c)  yields  all 
essential  Information. 


§3.  A  First  Order  Differential  Equation 

Let  us  now  apply  the  foregoing  results  to  the  case  where 
g(u,x)  ■  u^x"*^ .  Consider  ttie  function  defined  by 


CD  p  m 

f(a,c)  -  Min  (u'  ^  )  dx ,  u(a)  -  c, 


u  a 


for  a  >  0. 


We  begin  with  the  following  transformations 


X  -  ay,  w(y)  -  u(ay)a  , 


yielding 


(5)  f(a,c)  -  Min  .  glcm-n+1  »  j 

Ml  X 

w  ( 1 )  -  c/a^ . 

Now  choose  k  so  that  the  exponents  of  a  are  equal,  2k— 1  -  kiv-n^l,  or 


We  assume  that  m  4  l.e.  the  Euler  equation  Is  actually  nonlinear. 


Thus 


2  •H^-2n 


f  (a , c )  -  a 


?-«  CD  o 

w.  _  r'  /  .. .  2  .  w 


Min  r  (■•  +  _  )  dx, 

w  1  X 


w  ( 1 )  -  0  /  a 


(2-n)/(2-ei) 
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From  this  we  eee  that  f(a,c)  eatlefles  the  functional  relation 

2-t-tn— 2n 

?-m  (2-n)/(2-ai) 

(6)  f(a,c)  -  a  f(l,c/a  ). 


We  can  then  write 


2-HT>-2n 

2— m  (2— n)/(2-m) 

f(a,c)  -  a  <>(c/a  ), 


with 

(8)  <^(x)  -  f  (l,x)  . 

Let  ua  now  apply  the  partial  differential  equation  of  (2.5) » 
w..lch  In  this  case  Is 

3f  1  /  ^f  \2  tn  — n 

(9)  Fa  -  JT  (  Jc  )  -  "  ’  • 


We  have 


(10) 


?ln>— nj 

•  (  — a-  )  a  ?  (c/»  ) 

,  2-11  .  ,  ,  2+m-2n 

,  “  ^  (2-n)/(2-m) 

-  {  5^  )  ca  .♦•(c/a  )  a 


)  (2-n)/(2-n,) 

II  -  a  ^  ♦'(c/a  ). 


(2-n)/ (2-111) 

Now  set  X  -  c/s  and  substitute  In  (9).  The  resultant 


equation  for  Is 


(11) 


2  ■♦•(1^2  n 


)  ♦(»)  -  ( )  *♦'(*)  -  -  *"• 


Since  ()(x)  ■  f(l,x),  we  see  that  ()(o)  -  o. 

Since  this  Is  a  singular  differential  equation,  Its  numerical 
Integration  requires  some  care.  Observe  that  If  f(a,l)  Is 
continuous  In  a,  (whlcn  can  be  demonstrated),  we  have 
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(12) 


2-Hi>~2n 

2-m  (2— n)/(2-ra) 

f(0,l)  -  11m  f(a,l)  -  llm  a  <^(l/a  ) 

a  '^0  a— 


2n'  H>  2 

-  llm  X 
x->  00 


provided  that  tn  <  2,  n  <  2.  It  le  clear  that  we  actually  want 
n  <  i,  In  order  that  the  Integral  In  (3*1)  exist. 


We  shall  discuss  this  in  detail  in  a  subsequent  paper 
devoted  to  computational  results. 


§4.  The  Equatlc  u''  -  (  )  e^^u®  «  0. 

In  similar  fashion,  consider  the  variational  problem: 
"Minimize 


(1) 


j(u)  -  Z'  (u'^  e'^^u®)  dx, 

"'a 


over  all  functions  u  for  which  the  Integral  exists  and  for  which 
u (a )  -  c  . " 


Define 


(2)  f(a,c)  -  Min  J(u). 

u 


Then,  as  above,  we  obtain  the  relation 


(3) 


f (a,c) 


2Aa 

- 

r(o,c«  ^ 

2/^a 

Aa 

♦  (c.  ^ 

) 

). 


Using  the  partial  differential  equation  of  (2.5),  we  obtain  a 
first  order  differential  equation  for  (^(x)  similar  to  that  of  (3. 11). 
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